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Response to Arguments 

1 . Applicanrs arguments filed 2/21/07 have been considered. The previous action mailed 
1/19/07 is hereby withdrawn in view of the newly discovered Srinivasan reference. 

^ Allowable Subject Matter 

2. Claims 12-13 and 30 are allowed. 

3. The following is a statement of reasons for the indication of allowable subject matter: 
The prior art of the record fails to teach or fairly suggest the limitations "visually 

highlighting the video object in the video frame... with an automatic change of an object in the 
video frame that is visually highlighted" as recited in claim 12, and "visually highlighting the 
video object during the particular shot... with an automatic change of an object in the video 
frame that is visually highlighted" as recited in claim 30. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 10, 14, 15, 21. and 23-29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Wistendahl et al. (US 5.708,845 A) in view of Srinivasan et al. (US 
20010023436 A1). 

Regarding claim 10, Wistendahl discloses in a hyperlinked television broadcast system 
(see figure 3) including a broadcaster (30) transmitting a hyperiinked television broadcast 
(media content, N data and/or IDM program) and a receiver (32-34) receiving the hyperiinked 
television broadcast that an video object of a video frame (e.g., object A, object B as shown in 
figures 2-3) has associated therewith hyperiinked information, the video object being displayed 
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based on video frame data (col. 6, lines 1-4 and 29-39; col. 5, line 44 to col. 6, line 10; col. 12, 
lines 13-18), the method comprising: determining by the receiver whether the video object in the 
video frame is viewable during a particular shot (the media content is converted to interactive 
use by mapping the "hot spot" as separate data which are used in an interactive media program 
associated with the media content. Particularly, hot spot area A'(Fi) is mapped for object A and 
hot spot area B'(Fi) is mapped for object B in frame F. Thus, the object is displayed or viewable 
as "hot spot" that is determined by the receiver.), wherein the video frame is associated with one 
or more visibility bits (e.g., pixel values from N data or the display location coordinates of 
designated hot spot area in the frame of the video), and the receiver determines whether the 
video object in the video frame is viewable based on the one or more visibility bits (the video 
object in the frame is displayed or viewable as "hot spot" associated with the pixel values or the 
display location coordinates of designated hot spot area in the frame of the video. See col. 5, 
line 44 to col. 6. line 10), and visually highlighting the video object during the particular shot (the 
object may be highlighted when a pointer of a pointing device is positioned over the hot spot - 
col. 8. lines 40-54). 

' Wistendahl does not disclose displaying an interactive content icon responsive to the 
determination that the video object is viewable during the particular shot, the icon for indicating 
that the object has hyperlinked information. However, Srinivasan discloses displaying an 
annotation in the form of an interactive icon associated with the received image entity that is 
determined as hypervideo or having hyperlinks. See 0014, 0107. Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
system of Wistendahl by including an interactive icon displayed in association with the received 
image entity that is determined as hypervideo or having hyperlinks as taught by Srinivasan in 
order to effectively alert viewer the availability of the interactive content. 
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Regarding claim 14, Wistendahl as modified by Srinivasan further discloses that the 
annota^tion is displayed in response to a signal contained within the hyperlinked television 
broadcast (annotation data - see 0107, 0092). 

Regarding claim 15, Wistendahl as modified by Srinivasan further discloses that the 
annotation is displayed on screen in association with the image entity and therefore it will 
depend on frame by frame coordinators and/or change in displaying of image entity - see 
0107). 

Regarding claim 21 . Wistendahl as modified by Srinivasan further teaches that the 
annotation may be in the form of text (see 0107). 

Regarding claim 23, Winstendahl discloses that the object is visually highlighted in 
response to a user command (see col. 8, lines 40-54). 

Regarding claim 24. Winstendahl discloses that a plurality of objects are displayed as 
hot spots during the particular shot (see col. 5, lines 46-60). 

Regarding claim 25, Winstendahl discloses that the object is associated with a visibility 
Indicia (display location coordinates of designated hot spot areas in the video frame) Indicative 
of whether the object Is viewable during the particular shot (col. 6, lines 4-8; col. 5, lines 56-60). 

Regarding claim 26, Wistendahl discloses a hyperlinked television system (see figure 3) 
for indicating to a viewer of a hyperlinked television broadcast that a video object of a video 
frame (e.g., object A, object B as shown in figures 2-3) has associated therewith hyperlinked 
Information, the video object being displayed based on video frame data, the system Including a 
broadcaster (30) transmitting the hyperlinked television broadcast (media content, N data and/or 
IDM program) and a receiver (32-34) receiving the transmitted hyperlinked television broadcast 
(col. 6, lines 1-4 and 29-39; col. 5, line 44 to col. 6, line 10; col. 12, lines 13-18) . the receiver 
comprising: a display (34 - see figure 3); a processor (within 32 - figure 3); a memory (within 32 
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- figure .3) operable coupled to the processor and having program instructions stored therein, 
the processor being operable to execute the program instructions, the program instructions 
including: determining whether the video object in the video frame is viewable during a particular 
shot (the media content is converted to interactive use by mapping the "hot spot" as separate 
data which are used in an interactive media program associated with the media content. 
Particularly, hot spot area A'(Fi) is mapped for object A and hot spot area B'(Fi) is mapped for 
object B in frame F. Thus, the object is displayed or viewable as "hot spot" that is determined by 
the receiver.), wherein the video frame is associated with one or more visibility bits (e.g.. pixel 
values from N data or the display location coordinates of designated hot spot area in the frame 
of the video), and the receiver determines whether the video object in the video frame is 
viewable based on the one or more visibility bits (the video object in the frame is displayed or 
viewable as "hot spot" associated with the pixel values or the display location coordinates of 
designated hot spot area in the frame of the video. See col. 5, line 44 to col. 6, line 10), and 
visually highlighting the video object during the particular shot (the object may be highlighted 
when a pointer of a pointing device is positioned over the hot spot - col. 8, lines 40-54). 

Wistendahl does not disclose displaying an interactive content icon responsive to the 
determination that the video object is viewable during the particular shot, the icon for indicating 
that the object has hyperlinked information. However, Srinivasan discloses displaying an 
annotation in the form of an interactive icon associated with the received image entity that is 
determined as hypervideo or having hyperlinks. See 0014, 0107. Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify the 
system of Wistendahl by including an interactive Icon displayed in association with the received 
image entity that is determined as hypervideo or having hyperlinks as taught by Srinivasan in 
order to effectively alert viewer the availability of the interactive content. 
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Claim 27, see rejection of claim 23 above. 
Claim 28, see rejection of claim 24 above. 
. Claim 29, see rejection of claim 25 above. 

6. Claims 22 and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wistendahl et al. (US 5,708.845 A) in view of Srinivasan (US 20010023436 A1) and further in 
view of Proehl et al. (US 200301 31 356 Al ). 

Regarding claims 22 and 31. Wistendahl as modified by Srinivasan further discloses that 
the annotation may include text (see 0107). The combined teaching of Wistendahl and 
Srinivasan fails to disclose that the icon (comprising text) displays or indicates a time period 
remaining until an interaction opportunity will occur. However, Proehl shows that an indicator or 
a message 1 1 10 is displayed approximately five minutes before a program airs to alert the user 
of the upcoming broadcast. The message is displayed for a period of time giving the user the 
opportunity to record the program, tune to the program or remove the message (see figure 11). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the combined system of Wistendahl and Srinivasan by providing an 
indicator or message for indicating a time period remaining until an interaction opportunity will 
occur, i.e., selecting one of the options such as recording the program, tuning to the program or 
removing the message, as taught by Proehl in order to visually alert the user the upcoming 
broadcast. 

7. Claims 1 1 , 17-20, and 33 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Wistendahl et al. (US 5.708,845 A) in view of Srinivasan et al. (US 20010023436 Al) and 
further-'lh view of Dunn et al. (US 5,648.824 A). 

Regarding claims 11, and 17, the combined teaching of Winstendahl and Srinivasan 
does not disclose that the icon reflects a subset of the buttons on the remote control, and the 
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icon is displayed in response to a viewer's use of a remote control, respectively. However, Dunn 
suggests that displaying icon 100 provides control buttons corresponding to buttons 70 on 
remote control 40 in response to user's use of the remote control (see col. 5-6, lines 61-2 and 
figure 3). Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the combined system of Winstendahl and Srinivasan by 
displaying icon provides control buttons corresponding to buttons on remote control as 
suggested by Dunn in order to provide viewer an on-screen visual aid controlling presentation of 
video. / 

Regarding claims 18-19, Wistendahl as modified by Srinivasan discloses that the icon 
conveys information about content of the hyperlinked information associated with the image 
entity (see 0107). 

Regarding claim 20, Wistendahl as modified by Srinivasan further discloses that the 
annotation may be displayed in form of inserted text or graphical icon associated with the video 
image or image entity to allow viewer to select the image (hypervideo or hotspot) to view further 
information (see 0014, and 0107). 

Regarding claim 33. the combined teaching of Wistendahl and Srinivasan as modified by 
Dunn further discloses that the icon is displayed with a visual effect (icon is displayed with a 
represented symbol of shuttle control(s) associated with the remote control) that changes with 
time (e.g., the program is played or stopped), simulating the action of depressing one or more 
buttons of the remote control (for example, when the program is being stopped or paused, a 
play symbol is positioned relative to the actuator representing icon at a north location that 
corresponds and visually maps to the upper actuation position 72 of remote control 70; 
however, a pause symbol is positioned relative to the actuator representing icon at the north 
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location when the program is being played - see Dunn: col. 6, lines 10-36 and figures 3 and 5- 
6). 

Conclusion 

8. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant 
is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the niailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

^Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Ngoc K. Vu whose telephone number is 571-272-7306. The examiner can 
normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor. John W. Miller can be reached on 571-272-7353. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status Information for unpublished 
applications is available through Private PAIR only. For more infomriation about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you 
would like assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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